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Oyerview 

This paper covers three general areas. First, It reviews Bureau - 
efforts to improve verbatim> training and presents selected results/ from an 
alternative .trailing experiment-^^^^^^ tn the 1980 c^fl^p. Sec^d, it 1^ 

presents an overview of training^^^^^^^ being developed to support the • 

Bureau's increasing activities in centralized telephone interviewing. >J^^^^ 
third, it reviews some- of the evaluation strategies being implemeiited to 
determine training effectlyeness and to improve the quality of interviewing. 

Section 1: Background fd^^ Training Experiment / j 

■ • ■ • ■ . • .• . . 'v • ■ ; . , ■ ' -'4. ; 

In the past, the, Census Bureau has relied heavily on the Use of training 

' guides read verbatim to a group of trainees to deliver low costJ decentraiy 
ized ceasus training, as well as training prepared for continuing surveys. • 
Verbatim training guides are completely structured,; self-contained guides 
which reference all required training materials and provide step-by-step ^ 
instructions for conducting" training activities. Although these guides can 
be written'/in a vdri^ty of presentation -styles,^ there is a tendency among 
•writers of verbatim^ training to use more stilted language than is typically . 
found in conventional speech. Further, since;in a census context the guides 
are used frequently by inexperienced trainerSt training wMter.s have tended 

' to use lecture, rather than bther instructional methods, because, of the . 
fear that the trainervwould lose control of the training. The [result in - 
many cases has been lecture-oriented training which has •been criticized 
for being both boring and ineffective. 

In 1978, just prior to the 1980 census, the Bureau starte<l, a progri^^ 
training research with the general objective of improving ?xisiihg^ Bureau 
training. The initial goal of this research was t.b investi&at^ alternative ^ 
methods of training with applicability to both census and survey training.. 
However, as this analysis progressed, it soon became apparent that verbatim 
training had many advantages which other approaches hacL diffiailty matching, 
» at least in the cbntext of a census. These advantageis includea the following: 

• Standardization of training content; i 

• E!ase of development and revision • 
•Logistics (distribution, mass production)! 

• Ease of use (by inexperienced trainiers in| poor training sites) 

• Low cost • : . 

Although there are several alternatives to verbatim training which 

coul <t better present the content_j),f_census^tcain1ng-gu1des,r cost-benefit 

aftalyses ralsecT doubts about their applicability for census jobs typically 
lasting 2-4 weeks. TRerefore, rather than attempt to Implement and evaluate 

a totally new Instructional approach just prior to the 1980 census t_the___ 

decl si on was jiiaide,_Jnst_eaji^to-devel<)p-t^ n1 ng 

— possitJrle^ The genefaT 1 ntent was to develop a highly structured training . 
approach, .but- one which required the active .participation of the trainee. 
This effort focused on two areas: Introducing variety Into verbatim training 
fand' slpipllfylng training materials (with special emphasis on reference ■ 
manuilsl.'.'^The result was a method of training, called job-aided training, 
which was 'developed for use In the 1980' census and com'paj^ed to standard 

'^enstiS verbatim training. The major features of this training approach 
are discussed in the next several sections;'' 
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Introducing Variety into Census Verbatim Training , . ^ ; 

Acknowledging the feaK that inexperienced trainers (i.e;, individuals ' 
who, in many cases, were trained 1-2 weeks prior to the sessions they were 
to lead) could lose control of their training sessions. Bureau training 
specialists worked o^t approaches that avoided an over reliance on lecture 
for delivering information. These approaches involved the use of audio-, 
visuals with accompanying audio-casspttes, role-playingt, group learning ' 
exercises,^ discussion groups, individualized learning exercises, workbook 
exercises, and both group and individual evaluations. . 

■ ■■ " , . : . ■ ■ ' ' 

The overall- thrust of these activities was to change verbatim training" 
from primarily a lecture-oriented, passive approach to one wtiich required . 
active learning and participation on the^part of the trainee. Both training 
approaches compared (Job-aided vs standard). in the context of the 1980. 
census used these training activi-ties as a supplement to verbatim training. 

Simpl 1 fyi ng Tra1 ni ng Materi al s- ■ ^ * ' V 

Much of the training that was pmduced for the 1980 census was based 
on thg pre([nise. that classroom training would cover only the majoi>, mosjt 
critical job tasks. It was assumed that, once on the job, the Worker Would 
refer to existing reference materials to cue her/his memory about topics 
covered in training or to determine which procedures applied for tppics not 
covered in training. (Of course, another option was to ask for supervisory \ 
assistance.). However, an analysis of existing Bureau reference materials 
revealed several problems with this assump,tion. First, infdrmatidh critical 
to performing a job task often was in more than one reference manual* ^ 
Second, it was difficult to locate information in the manuals.^ And, finally; 
once the correct procedure wais located, it was often difficult' to use because 
of jargon and the presentation format. To address the dual probleinS of 
accessibility arid comprehen'sibility of procedural. information, a-riew .training^ 
approach^-cailed "job-aided traini ng"— was developed and tested. ' ' 

Job-aided training requires changes in both the development of .instructional 
material and the presentation bjf procedural information in manuals. The 
nature of these changes are distussed in the following sections. 

^ Job -Aided Trainin^^ . ^ , * ' 

Defined as simply as possible, job aids are any device that helps a. 
person perform; a job better. However, .the majority of published research 
has fjocuS?fd_on the use ot^ "paper-^^ aids and the use of alternative 

formats (see Lineberry and Bullock, 1980) for presenting procedural Informa-^ 
•tlon. In the broadest sense of the word, any manual is a "Job aid" but, / 
Jji^p racttce/ a_job_ai-d-manual-has-certain-un1tiue-characterl3t;jcsT7^ne of^ 
these characteristics is the use of certain formats for presenting procedural 
information. There are three formats that have been widely used. These jare 
checklists, flowcharts, and .decision tables. Illustration 1 presents an 
example of a simple Qhecklist. To use this job aid, the worker proceeds/ 
sequentially down the list. . ' 
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ILLUSTRATION 1 . 
; Example Of a Checklist Job 



3E THERE ARE 8 OR 9 PHOPLE 



9 



instructions: If there are 8 or 9 o'ccupantsin the housing unit. Use the following checkKst>^ ' ^ > 

, ■ V ■ " \ • _ ^ , ■' • . _ . ' < 

1. Put 7'peoplaori the first questionnaire. ' ^ 

2. On a second questionnai» (same type as the first-short or long) put the rest of ^e pepple. But: 

a. PuttHe.name of theeighth jpierson in cohjmn2 on page2 and on pageS (if long folrnjof the 
' second quesrtiQnnaire. \^ i 

^ b. Do /7jpf cornpli^^ hoysinig guestion^^^ questionnaire (continuation). 

3. Make sure address labels for both queistionnaireS^are the sarrte. Print "continuation"' above the 
addr<^ label on the seH[:ond questionnaire. * 

4. Figure 17 shows how to coniplete the FOR CENSUS USE ONLY boxes. 

5: Make usual entries in the Master Address Register. ' 



I 



/ 



Another commonly- used, type of job aid Is a f lowchart \6r algorithm) as 
shown In Illustration 2 on the next page. [ * , 
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; ' ' ILLUSTRATION 2 - . * . 

Example of 4 Flowchart Job A1<1 with Accompanying Illustrations 
4B. THrHOUSlMG^AllT DdES NOT APPEAR LIVABLE 

Fi(^ra32. ' 



..■••\- 



START HERE 



I 



Do«$ th« housing unit have any one <)f tiii following characterijticj? No one lives there, and 

1. Roof, walls, wFndpwSyand/or doors no longer prtJtert the inside from the wathfT- (This 
does ndtindude a pfapetiiat is boarded up.) ' ; , . - 

2. it is belnj demolished. " , 



3. 
4. 

6. 
6. 



There is a sign saying *at it is condemned or unintuibltabl^^^ • ' 

It is^ing used for nonresidential storage, for Ixample, machinery, office furaltOre, or i^jdystrial 

supjpiies.' . ., ' \ ' : • : IL^..'^ ■ 

it Is under construction, but the flnili windows and doors arf not y i^J- In place. * 
The housing unit has been eliminated becaAe of conversion, recftodellng, qr denrolitlon. 




1. Oo not complete a questionnaire. 

2. Correct the Address Listing Page (figure 33)1 

3. Be sure to enter the reason for'crossing out Wie- 
the listing. For exai?iple, house burned dowt^^^ 
demolished, vecant trailer site, condemned. 




-J... 



Coitiplete a<questionfiaire for a 
vacant unit. i " 



Figure 33. Completing the Address Listing Pege when tiie unit appears uninhabitable. 



Line out listihg^d 
-enterdate and reason^ 



ERLC 



















to* 






mm 




T 


mm 9 " t . 




nE3 






1000 




APT1 




mm 




a 


JOOI 










3S<-»J0/| l_ 


m 

201 


1000 


imjcATK n 


ATT 2 




4 


a 


0202 


f-f 


/ 








201 


1000 


AmSAlS Dt 




imoua 




i 


I 


0203 




0 








201 




jimicATE Da 


mi 


ivntMi 


Em 


-1. 


9 






4 








201 


1002 


urucLVt sa 




antmi 


1 


8 


0205 




/ 








221 


100S 


imjB&iTiDa 












J22flZ 













\ Drayy wavy llne i 



Eniter Cln 



To use this aid, the worker begins In the "START" box and follows the _ 
appropriate arrows. • As Is apparent 'In Illustration 2. many of these^alds 
are accompanied by Illustrations which clarify fmportant points 1n;the. 
written Instructions.- ' * - ' 

A point -worth noting about the flowchart job aid. is that it' Is not as 
easy to use as the checklist*.. Wherea? a trainee typically has no. problem 
^picking up a,.checkl 1st and using It. a ''flowchaii;, features a novel format 
whIch'Tnust fVrst be explained during training. 

Thrthlrd type of job aid which' ts commonly used Is'the decision table 
as shown In Illustration 3. • . 



JLLU 




ION .3 



Example of a^Peclsidh TaWe, Job Aid • 



-'VIF,^'..' 




' THEIi , 


Person Iss 

■ ■ /. 




Complete: 


^ Male; . . 


Over Zl ' ^ ' 


Section A 


■ ,. 

; / Under 21 


Section D 


female " j 


Over 21 ^ • 


' " ■ ' . .■ ■f' * 
Section E 

* - . • 


Under 21 



As with the flowchart job aid format, this type of job aid also requires 
some Introduction "in training prior to Its use In the field. ^To "5^ * 
worker simply starts in the left-hand c'olumn. finds the condition (male or 
flma?e) Sat exists. applies';any f aVIfying^lhformatlon^Ce.^^^^ or 
under. 21 W and then- f ol 1 ows the ^i recttons^ 1 n the "THEN c olumn.. 

-Theoret1cal-Rat1onaTe-f^r-j6b-A1ds — v - . 



The theoretical fat-1on^1e urideVlyinrthruse of job>,a1ds 1s^ t^ 
serveTas a Itorebouse of Infomatlon which does not have^to be extens vely 
covered In training. Accordingly, training Is simplified because less 
"fomati on needs to be covered with Immediate or direct recall as perfor- 
mance criteria. ' . 

The design of job aids relies on theoretical concepts derived from a 
theory of learning, called Stimulus-Response learning theory. In concrete. 



terms, job aids are designed to cue a worker •s memory for skills learned 
prior to the job (general skills) or procedure§/concepts learned during 
training (job-specific) skills. Job aWs are written using principles of 
clear writing and present the minimum amount of information necessary to 
complete a task successfully. In more sophisticated applications of job 
aids, designs are also employed which can be used by Workers of varying 
degrees of skill and experience. 

steps In Integrating Job Aids vand Training Design 

The preceding discussion emphasized the unique formats- (see Illustrations 
1-3) associated with job aids, but the sucfcessful 'use of job aids requires 
more than simple design or changes In format. It Is equally Important that 
attention be paid to how training materials are developed and how the pro- 
cedural manual is used in training. For exampTe, the successful use of Job 
ajds requ'lres at least the folloyiing steps: \' * * 

1. Task analysis (to determine What the worker does). 

2. Speciflcationof training objectives. y ' 

3. Integrated design of training content, ^nd manuals to detemjine ^ 
^fie following:. ■ v , V 

a. What job tasks should be covered orjly in training? 

b. l/hat job tasks should be covered only in reference ~^s) 
manuals? \ ^ ' . ^ ' 

Cf What job tasks should be covered in both formal training ■ 
. arul reference manua^ls? / ^ - * 

4. Design of Instruction and development of learning activities 
emphasizing use of the jpjb aids (manual ). * . ' ' 

5. Concurrent validation of/trainiag and job aids. 



j Since the design of training and* j'ob reffererice manuals proceeds concur- 
rently in the preceding models 'the mosjt- Immediate benefit. i-s that subject- 
matter experts and training rfeslgrierswbrk together to identify critical 
job tasks, assign training 'ppibrities, clarify ambiguities in existing or. 
proposed procedures, and agreie on examples of competent performancei More- 
over, since job aids are an -lilrljortant component of training, ^the training 
Itself tends to be more attive and skill-basfed, and relies less on liecture 
as a means of presenting information.; ' / 

Ultimately, although the decision to exclude or include a specific job 
task in training >depends dn the judgment of the training designert Joy?e : 
et al. (1973)," J ist a variety of factprs that need to be considered before ^ . 
making the manual-training tradeoff.- Sor^^^ 

by Joyce et al i ; are' that tasks covpred ifi-tralnlng s — „ - 

1. Be difficult to learn on the jobi j \ 

2. Be difficult to communicate with words. 

3. Require a great deal of practice. \ . * 

4. Allow little, room for error. i ^ / 

5. .Be (jerformed frequently on the job.- , 
6j>i Not allow. time to refer to a manual. 

7. Be performed by a, large number of -individuals in the 
job area. v 



On the other hdnd» tasks suitable for 9 job manual are those 'that: 

■ • " ' ' • ' 'A. 

!• Have long and complex behavior Sequences* 
^ Z., Are rarely performed* • • . ^ 

^ Involve' readings, tolerances, or table lookups. ' 
4* Can be mentally rehearsed prior to peV^ormance. 
5# Benefit from the use of illustrations. 

The development of trainin^activities follows' readily fl^om the develop- ^ 
ment of job aids. Since job aial mirror the performance of actual job tasks, 
skill-based activities can be easily designed that enb>urage individualized 
learning as well as provide immediate feedback about tne ^correctness of ■ ' 
behavior. Moreover, formative evaluation is enhanced because the step-by- 
step nature of job aids quickly reveals exactly where performance problems 
are occurring. . . ' ; 

Characteristics of Job-Aid Manuajs and Accom'panying Training 

In the Alternative Training Experiment mentioned previously, a standard 
field procedures manual for follow-up enumeratorsi/ was redesigned a^s a 
job-aid. manual. One resi/it was a significantly shorter manual. The job^d 
manual was- 62 pages .versus 129 pages fQiT the standard manual, even though 
the same procedural information was presented. Excluded from the jpb-aid . 
manual was background and ^nice to know** information about the census. 
This infbrmatiorf w^ "Covered, instead, during training using audiovisuals 
and classroom leeti^e. ' ■ 

: The jot>-aid manual also differed \in its organization. The job-aid 
manual was organized around major job tasks and field problems as the 
enumerator would tend to verbalize them. To illustrate this organization,' 
a page from the Job-aid manual*'^ Table of Contents is presented in the 
Appendix. On the other hand, the standard enumerator manual was organized 
around more general enumeration topics. For comparison, a page from the 
standard man(jal *s Table of Contents is also presented in the Appendix. 

- ■ ■ : ■ ...... ^ ^. • 

other fealjures of the job-^aid manual were that it required less cross- 
referencing, used more "white space" (spacing between print) to avoid a 
cluttered look^ and principles of. clear writing were used throughout. The 
training that accompanied the use of the job-aid manual also required 25% 
less lecture time than thie standard enumerator training, even though 
comparable material was covered. . r . ^ ^^r-^ 

^ ' ■•■ ' ' * . : . . ..- . r . , , • . * ' • ■ 
-What-Does-Prior^Researoh Show? — ^ 1 — — ^1:1^^, _L^,_J 1 _^ . 

Evaluations of the use of job aids have indicated that the use ofi specially . 
designed job aids enabled inexperienced maintenance personnel, to/otftperform : 
rlbre experienced workers who used tfaditiorial reference materials (Fbley, 
1973), that job aids were well accepted by maintenance personnel whethec^r 
not they had input into their development (Johnson et al., 1977), and that ' 
. job aids could be used effectively with disparate instructional methods 

(Swez^, 1977). . / ^ " ' 

l/Fol low-up 1 enumerators were responsible for obtaining information from/ 
Tfousehblds which failed to mall back their census questionnaires; ! 
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Evaluation of the. Use of Job Aids In Census Training 

r ^ ■ — - " r — ^ — ~ \ — \ 

In the- context of the 1980 census, an alternative training approach using 
job aids was developed for follow-up 1 enumerators and compared to standard 
census training,. The major difference between the standard census training 
and job-aided training vftis the .use of a field procedures manual redesigned 
to be a job-aid manual/' Three pairs of census district offices were matched 
on variables related to the difficulty of enumeration. The offices in each 
pair were then randomly assigned to one of two draining methods (standard 
or job-aided\, resulting in three experimental and three control offices. 
^. Data from 1,197 job-aided trained enumerators and 1,389 control enumerators 
were available for analysis. Attitudinal data were collected at the end 
of training and then after 2-3 days of job experience to determine if 
experience changed enumerator perceptions of training. Performance data 
were also collected biit the occurrence of field problems precluded a mean- 
ingful analysis. 

- A general finding was that both training approaches (both employed 
verbatim training guides) were/apparently successful in terms of positive 
ratings given by enumerators. Table 1 shows the responses of enumerators 
, to the question "Overall, how would you. rate the quality of the training?" 

. ■ ' ' . TABLE 1 /■ ■ . ; \ ' ■ ■ ,. • 

ENUMERATORS' RATING OF QUALITY OF TRAINING 



End'Of-Tralnlng Post Training 





(N«1.163.) 


(N-1.093) 


(N-887) ,^ 


(N-526) 




' ■ ' . ■ '.3 ■ 
JobrAlded 


Standard 


Job- Aided 


Standard 


Very Good .s, \, 

*• • 


' 57.03; 


49.0s 


58.7% 


.44^.9% 


Good • i 


37.8%- 


42.1% 


37.1% 


: 46.6% . 


Fair - • 




8.3% ' 


3.1)%, 


8.0% 


Popr.., • ly. 


0.7% ' . 


0.5%V 


1.1% " 


0.6% 



ratings. The marginal asisociation between ratings of quality and group mem- 
bership was significant for both the end-of-training (x^ « 22.7, 3 df, 
p » p.OO) and post-training comparisons (x^ ■ 36.8, 3 df, p « 0.00). In • 
interpreting this riesult and subsetjuent ones, it should be recalled that 
feniimerators saw only one type. of fdllow-up training. Therefore, the basis 
for judging quality was not the standard census training. 

.Response rates In Table 1 for the job-aided grodp were higher for bdth 
th* end-of-tralnlng and post-training comparisons. The reasj^nS' for these , ; ,, 
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resjionse differences are unclear'slnce Identical clerical procedures were use^ 
In all offices. The most likely explanation appears to be that senior field ^ 
supervisors liked the jofaralded trajning and made ai greater effort to distribute 
and retrieve evaluation iTorms. Their counterparts In the. control offtces did 
not oversee -any alternative training, so evaluation foVms may have 'been viewed 
as an unnecessary burden, and thus Ignored. Jhe lower V response. I'ate for: both , 
groups for the post*-tra1n1ng questionnaire wds caused by distribution and 
retrlevaT problems associated with a widely scattered work force'. Since 
.senior field supervisors did not train enumerators, they are not viewed as, an 
'important biasing factor. Hovf ever. It* Is acknowledged -that other systematic 
differences among offices could have affected the att 

' Another question dealt with an enumerator 's\f eel Ings of preparedness ; . 
prior to field wor^k (end of training) and: after 2-3 days of /job experience. 
Table 2 shows the responses of, enumerators to .the question "How'^welT 'prepared y 
do (did) you feel to go oiit and work as an enumerator?* 



TABLE 2 

ENUMERATORS' SELF-RATINGS OF DEGREE OF PREPAREDNESS 



End»of»Tra1n1ng 



Adequately 
prepared ' v 

Poorly Prepared 

Not Prepared 



(N=l,758) 
Job-Aided 


. (N»l,085) 

♦ ■. ■ ■'■ , 
Standard 


(N-919) 
Job^Alded 


47.8% 




60.8%. 


• 51.6% ; ' 

0.6% ' . 
0.0% 


50.1% 

: 1.6% ^ 

0.1% 


38.0% 
1.0% 
0.2% 



Pi^st Training 

.. ■ ( N=557) • 
Standard 



■ h54.8%. • 

42.7% 

■•V,2.3%. 
., . v ^p.2% ; 



C 



Again, one conclusion that can be drawn from this table Is- that both 
training approaches were successful In, making enumerators fee.T that they 
were prepared for th&ir jobs, both before and after. job experience. Further, 
in both training approaches, the proportion of enumerators who felt.. that 
they had been "wel 1 prepared" actually increased aftier job experience^ Two 
• separate cross-tabulations indicated that there were no differences; between? 
the training groiips in theix pattern of ratings at the end of training, < . 



but a significant difference was observed at the post-training comparison 
(x2 » 8.45, 3 df,,p « 0.04). A subsequent logfllnear analysis indicated 
that there was no' three-way Interaction preterit. ^ i . ■ 

other questions on the reaction tjuestlonnaVe that enumerators conipleted^^^^^ 
dealt with the tomprehensibility of training materials, the.length of training, 
and 'coverage of critical job tasks. Consistent with exNcta^^ 
aided training was perceived to Have used more comprehensive training 'materials 



and til be of a more apprbprlatejlehgth. Furthers When enumerators were asked 
after job experier^e (2-3 days); which, pf ten majdr Job taslcsi^were ribt covered \ 
"viell enough during training;'?: ttje 'control gf^up^ more frequehflyvCfi^cked s 
out of the ten tasks ( ^ <■ .(^ ;l"df)^ 1)ie^^ no stattsticaT differences \\ 
» on, the remaining four tasks. . ' v ^ ^ • ' ; r V 

- An Irtportarrt objectflve ;of the, jp^ 
materials more during tralnlrtg; Fuftiher, since th6 purpWe of a 
aids was to make Information more accessible and comprehensiM i 
It was expec.ted that the enumerators using the job-aj d manua 1 woul d use It \ ^ 
rnore frequently once they began wofklng^ cThls expect^^^ also confirmed.' 

table 3 shows the rep6rted use^"^^ job referencis manualV for eniimer* 

ators, the field prodedures; manual r(j^*^ald; or standard) "and theitQu^stlcmrialfe • 
Reference: Book (QRB)^hlch gave; quests bh-by-q^ specifications for each 

;quest1oh bn^ census^ fpni|.^ QRB was fiot' redesigned, itrtwas 

Ihclijde'd^^n this queitiori;^^ manuals^ 

;deiBmed^niiost;;critical^^^^^^ the jpb.VV'^ -■■-.^ --^^ '-'i }:0-'^;:, y^ ■■';'-'")^';-. 



REPofeTEtt: AVERAGE^^^;!^ REFEREHCE M v " ^ 




4). 



• ' , - -7 Job-^AIcHed ^ : SVD. ■ .. . Standarcl :^ - S.D. 

Fteld'^l*ro<redures;'';v - /v;' , , ; ; ;:^V' ; ; ; ■.■/■■''■f;; :' :-'*^/V ■ " ■-.,..'■^■ 
Manua^ ,. (Job-Aid^'" ■ ' .^:....v" 

.or Standard) ^ ^ 2.02 ; ■ -' 2.13 ' " \ 77 ■ ' ^ LSI- 
Questionnaire ' . . 'i'^- '^-' '^i/^- 

Jleference Book 1.04 . - . ^ fl.66r r^^yi.2!7- . - 1V59, 



V ; An^^nalysls of variance model fpf^ nested factors (census district pfflc$s V 
\ nested under tral n1 ng apprpach) deie^l n^ t^ie reported use ^ the: f iel d 

projcedures manual was greater In the office? Vhic?^^^^ 

(Wfner, 1962, p. 184). However.v It was alstf^^p^^^ 

not use their manuals^ as frequently as had be^eri €{xpetted« 

expTahation for thi^s retatJyfd^^ use;X)f manuals wis^t^ t>ie^t;Srain1ng: [v.^i-'h. 
-Jyid bgen^jso effective tha^ the cieed to use manual s'Swas ' 
another e^^planati on is" tha^^^^^ reference mar^ 

and, therefare.^ 1^11^ ^/ ^^^^^ 

. y:^^ based on the design of the QRB (ith^as a 200 page manu^^^ 

'that it would not be used frequently. Table 3 CDhfirinis rthi& eaj^t^^ 
difference in reported usage of the QRB between -jpbralded ai^^^^^ 
' is attributed to the^ fact that some of^ the^more freque^^^ 
the QRB (e.g./ age conversion t^ble) ^was a.Up inciyded^ 
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«eonclus1xms= 



■. ■■■ ■■■ v' ■ 

, • , ' J. ' ' ■ '■'■.'1 




The .• results bit- this stu(^ i^ thatythe use^of iob^^^ roaniiars ' 

; ia)^t>tra1n^ results In mbi'e- Effective :t raining*;; Aq^ 
: " currjintly.makjjtg plans to use ^^^t^^^^^ a'<Wlder baisls^ 

: ,y"^for;the '^990.:.census; '.^ Vv'';''i 
■ ;$6rt1on:^; ' T>a^fy[ng for ^lephonte Interylewers- w v':''|^-ir f ^x/-^'':^^ 

• Fj eld Intervlewer^s for the -OTKre Bureau • » 

of telephone Interviewing after -Initial personal vlisilt^ a hbusehqld.' i : ; 
\Typ1cally;- this Interviewing is donie from thfeilnterVt^swer's "home,: Rewotli,"^^^^^^^^^ > ■{ 
-v^hQwever;^he^ureau^has^been~«<per1ment1ni^ 

- . telephone 1 nterv16wli»g faci^ Ities at; Its Sultl and headquarters fcfr -fon^ : : W 
' *iip of mal 1 surveys., one-time surveys* .and cqntlniilng surVeysV^ 1^^^^ ■ 

- rnental ef f o,rts have > offers the bpportiinlty if or devel opl ng ahd-^te'st 1 ng ' . ^ : 

"> a;l tern'ijt j ve t rai n1 ng approaches to verb.at1m' training TheSe' al ternatl ves ^ v 
' • have emphasized sel f-paiedi Ihdl v|aual tied Instruction a'S: yrfel 1 as sill ll-baised> 
. classi*oom tralnlhg exercises-. ; The' generar approaches attemp^^ed will' be' 

■ dlscusse^-lri the next several sectl^ ^ 

Al ternlt1;ve&^t d : Ve^bat 1m Train 1 ng : viSel )r-P^ace(^ ittstr u ctl on 

■ r A Sf mpl e def ^ hi t1 on of ■ tra+nl ng :1 s that* 1 1 Is a-^^coc'ess desi gned *to - ' • ' 
. encourage the acqulsttlbn -of a ^peclflj; Mt 0^^^^ 

most- survey trai n1 ng sett^l ngs , It Is possi bTe tb^ define these skills I41 . ' 
behavioral , and heh^ on^ InstrDC- . 

tlonal technlque f or -descrl bf ng or 4ei?jOnst^at1ng; f s^^^^ red sicll.l s and ' 

knbwligdges^ but itS"'11m|tat1bnS ;are .such ttia^ progresls 
at a pace cohducl^a to the. slowest lea rnersv^mu<ih^^^^c^^ 
; may be unnecessary fbr inajriy bf the trainees,; the trainee can ^^^^'^^^^^ Ignore or. ° 

lecture, and underStahdl^hg a verbal descriptibn of a skill- 
Is no guarantee that the skfl 1 can be perf prmied (for examplf , th^ 
pol nt 1 s anal ogb]us to ^xp'lal n1 ng to a non-swimmer hbw ; to^ sWlm , and then . 
asking higi/her to jump .1r\'a pool).-' ^ , ^ ■ ' 

'X Sel f-pac!Bd -instructfon. deals with many of these 11ml tat Ions... (except 
. ..the last one) because tjt r'equ Ires each Mrson to proceed through the same 
, material . Further; since each person ^pr^^^^ own" pace, training' 

times are typically reduced and rtore Tearnihg -occurSV self-pacing 
can 'be' accompl'ished iislng a vartety pf .fnsti'uctional^^^^^^^^^ ■ 
.printed text, television, computers, audiovisual s, etc.jv The mbst commonly 
.- used self-'pacing technique Is a printed programed -text. ii Based, on the prlncl- 
; pies of Stimulus-Response (S-R) theory In experimental -psychology, the basic' 
design of progr^amed- Inst ruction Is "(1) explain ^hat: the learning 'Objectives 
are, (2) present Information in small i' "lea rnable^ xhunks, (3) require a" 
response from the learner to test acquisition of vthfe bbjective, and (4) 
prbvitle the learner; with feedback about the correctness of the response. 

Census Jureau Osei of ^ self -Paced InstiHictiony - - 

V' • - ■• ■ ■■■■.%..:■■■:■'■■-■■■» "^-^^^ ' -Vy 

To date,^the Census Bureau has experlniented with a\ variety of -self- ..v 

.pacing ,techrt1ques* tn both its census^^ The most xoranon 

. "^approaCtt tias been pri nted programed text but , recently , to support t rai ni tig ~ . . 



Vorxentpiill zed telephone Ijitervlewtng, the Bureau has developed self-paced • 
audljo-cassette tralnin'^ (wtth;an acCOT^^ as well as^.Gomputer--. 

' .assisted. Instruction; '^^^.^^^ ^ .' • : • - • • v ■ . ' ^ , . . - 

; In general , the sel f -paced' ttJai hi ng m^^^ 
have covered general skills or knowledges; The objective of much of this . 
-training has beerij to present an overview ahd background for a rSpeclflc job. 
' . For example, training prepared for central IzedtelfiChone Interviewing basic- ^ 
1^^^ a general' 1 ntervlewTng ski iTs training module and 

v a survey-sipficific tra The general Interviewing skills training 

\ module covers the/f oil owi ^ ' .i 

^^---^-^^^1.— Asklng Survey-Questlons^ — '-^ — ' • ■ • . — —^^ 

^- 2. Clarification and probing ' ' - \ 

- ; > Dealing with Reluctant Respondents ^ . . 

^-r'] "\ • .'The survey-sped f 1c module covers the procedures unique to a survey as ^ - 
■ ? wel-l af -quest lon-by-questlon specl f 1 cati ons. 4 , .^^^ . 

. .A self -study approach using audio-cassettes was decided upon for, two 
. reasons. ' First, audio-cassettes require Inany of the same skills, essential 

for a telephone Interviewer. Specifically, an Interviewer must listen to a 
-Spoken message. Interpret It, and then record a response. Second, turnover 
' among telephone Interviewers has been , a problem, in many organisations. - 
Therefore /NSelf-pacIng a portion of the trilnlng frees supervisors for 
• other actMtles -and speeds the training of replacements. 

r Limitations of Self-Paced Instruction ^ - /' 

Although-.self-paced fnstructlon requires each trainee to proceed - ; 
' through a set of standardized material , tl?ere are limitations .to Its use. 

For example, research conducted In the military servldes with self-paced , 
. training found that Indlvtduals with poor literacy slcllls ^Id not do well 
In Individualized training and. Instead, prefierred small -group discussions 

- and .demonstrations with a trainer (this finding led the Bureau to use audio- 
cassettes versus hiaiving. a trainee r^ly on reading to acquire Information). 

^ Further; there "are .logistical .problems associated with self-paced training. 
For example, distributing and recovering equipment, payment for different 
training times, and- verifying that the. training was done at all are common 

- -problems. Finally, the time required to desigr and develop self^paced , 
instruction is typically longer than that for comparable verbatim .training; 
Computer-assisted (self-paced) Instruction '(or CAI as it -is coinnbrtly'called), ' 
deals with many of these problems but is eve'ii more time consumifig to- produce - 
because of the special programming required. Development times of. 40 or , , 
niore hours for each hour of instructional time on a Computer are .considered^ 

' excellent, ahd one research project that this writer was Involved with- in 
\ military techrikal training resulted in development' times welT in excess of 
100 hours for each average hour of instructibn. r v . 

Another general limitation of any type of is:eif-paced training (but 
: especially true of CAI and audTovisual tra1n1ng)-1s that last-'minute revlsiohs 

and changes in procedures arw'timfe consuming and expensive to iitcorporate. 
' It is relatively easy to chemge a paoe in a printed text. It is r totally . - 
different problem to changes serle^of screens rirt 'a ftlmstripj?, '" - 
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Alternatives, to Verbatim Training; v Perforntance-Based Training 

In many jobs, the most effective type of training would be to pair a 
trainee with an experienced Wbrker who cbuld then demohst rate job skills . . 
ancf provlde, Immediate feedback to the trainee about her/his jjerforniahce. " 
Although "apprenticeship" training Is an attractlve^alternatlve, the unique.. 
. demands of; survey -research, as well as turnover -rates of "personnel, preclude " 
its widespread use, although variants of>1t (for exam|ile, on-the-job training 
provided: fty supervisors after formal classroom training) are commonly used. 

' Although "apprenticeship^ training may not be a viable alternative for 
training Targe numbers -Of, Interviewers, the basic approach can be simulated 
In. formal classroom training by attempting to enhance the fidelity between 
— tral n1 ng^actl vltl es-^andTjob ski 1 Tsv-^Essentl^liyT^benjse-of perf ormaff^^^ 
based training (see Taylor etal., 1972) requires the following changes In 
training' design: ; 'i 

1. Traditional orientation and familiarization training Is * 
V'. ■ replaced by training that requires an intervfewer to * 

demonstrate performance of a Set of hi gh-priprity skills. ' 

2. ; A ''lecture-demonstratloh-practice** par^^ 

by training that emphasizes individualized skill practice. 1 

3. Lock-step, grpup traintng is replaced by individualized 
' (self-piaced)' traiiii^ 

4* The trainer's role changes f rcffl one of mainly presenting 
informatiiDn to roles of demonstrating skills^ organizing 
skill practice exercises, and providing feedback to the 
trainees about their performance. 

5'm Little use of evaluation measures is changed to the - 
frequent use of evaluatiort^^exercisel 
and end-of-course proficiency reviews,' 

- The' general thrust of the pi^eceding changes is to develop training 
which requires active' learning f^qin the participant. In addition, ampje 
opportunities a^re provided for a trainee to assess her/his acquisition of ^ 
jSikill^ and to obtain feedback about that performance. 

Techniques for Implementitig Perft)nnance«Based Training in Survey Research . 

In its effort's to fnfpVe^ training, the Bureau- has 

rel4ed on the ujse of.^simpl,1f1jsd reference material s^ learning, 
group-learning exercfseV tsuc^ as role-^ discussion groups,- problem-^ 

sol v/Ing groups V etc.), and warkbppks.^ Ifi additii^^^ of eyafuative^ , 

exercises have been- deyelopdll for usfe dur|np training; as -well as at "th6 / 
end of training. , : ' . ' \ ' : . ' ' * • 

For training telep^hoi]ie i:ntepvlewers,^ t use of practice interviewing :v 
exercises remains the most fruitful approach for impTementing performance- . 
based training. * As used to date, practice interviewing has been implemented * 
either'through the use of completely scripted practice interviewsr- or '*f art h - 
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sheets*^/ To provide feedback, the Bureau has relied on ojbservatlon of , ^ 
practice Interviews, as wiell as a telejphone monitoring system which can be 
used to 11 stea to Interviewers practice Interviewing, " - 

In general It has been found that practice Intery - 
successfully conducted In* pairs with cine trainee serving ^s the Interviewer ^ 
. and the pther playing the role of respondent. Further, scriptied Interviews 
appear best for covering specific problem areas or procedures, jal though fact 
V sheets can be used in their place If thevlntervlewer trainees have sufficient 
experience with >ole playing, y . ^ ' - 

Se.ctlon .3i; fevaluatlon of~Interv1ew^^^ /.^ ■ ^ ' 

The 1ntr«|luct1on of centralized telephone interviewing facilf^^^ 
the headquarters of the Bureau has provided the opportunity to exact more 
direct control over the selection, training, and supervision of Interyl ewers, ^ 
since it has long been acknowledge that none of thiese functions >re Indepen- 
dent of -each other, W1th"jn this context, effortis In selection, t raining , 
and supervision will be discussed next that are relevant to the evaluation 
of interviewer performance, 

Selection; Mini-Straining and Evaluation ' --^ 

In an effort' to improve the selection process for interviewers, the 
Personnel Division of the Bureau has been working on the development of a 
selection process called "Mini-Training ^nd Evaluation" (HIE). The rationale 
for this approach is that. the best, and least biased, predictor of job success 
Is performance by a iob. applicant on a subset of tasks that represent the job 
In question, , \ ' - *. . 

Accordingly, for the job of telephone interviewer, a representative 
sample of xritical jbts skills were I a 
niini-training session covering these tasks. Essentially, these criti'Cal . 
skills covered questioa,ask.ing. probing, clarifyingi and dealing with reluc- ■ 
tant respondents. After the mini -training session the applicants conducted 
an interview With a person' who ^w^ trained to act as a respondent, and who 
by using a scripted Interview, was able to present a "standardized" interview 
for assessing the 'interviewer's skill. Since this "test" interview was re- 
corded, a team of raters were then able to rate the quality of the interview 
on a variety of relevant^ dimensions (for example, art iculatio/^ question 
asking, following skip patterns, etc,), 

. ■ s ■ . . . ■ M ■ • 

• besides tihe content yalidl.l-y of this approach, this selection process ^ 
' also has other benefits. Because It Is a relatively demanding exercise. It 
serves as a .screening device for less motivated Individuals br persons who ^ _ 
fiave no conception of what telephone^intervlewlng entafls. Therefore, an . 

. . - ■ :\ \^ : • ■ ■/■ ■ .■ ■ ./ . ■■' ■ ,; ■ ' ■ ■ '■ ■ ; ■ 

,2/ In a scripted Interview, the trainee acting as a respondent has a script / 
with respondent answers and required or suggested Interviewer behaviors. 
Accordingly, \spec1f 1c concepts or problem areas can be emphasized. Fact / 
sheets are lists of critical Information to be supplied by a respondent. * 
^ . Required or. suggested Interviewer behaviors are not presented. . 



■:■.,;/.'■,.•, 
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expectation Is tbat turnover will be -i^educed botlh.' during- and aftfer training. 
Further, an urtconflrmed expectation at this polTit -Is that the "test" s^tve ^ 
resulting from the MTE process will pred1ctvdob: perfbrmarice; that Is, the 
selection score- will have priedlctlve valtdlty which hopefully exceeds that 
obtained with current selection tests. . : </ ' ^ \ V 

In terms of Its Impact op training, MTE should suppl^^^ Interviewer 
^trainees -who are motivated to' perfonn the job and-.who have the minimum set 
oT skills, necessary to be a successful tele^Bfhone lrite^^^ 

Evaluation of Interviewer Perforinaince^Durlng Training ' 

AEvaluatlon of Interviewer performance during tra lining remains the 
respor^slblllty^f the trainer; however, evaluative exercises have Increas- 
ingly been used both during and- at the .end of training. Evaluation during 
tra1n1n^g has relled-.prlmarlly on two 'techniques:, observed^ or monitored 




practi( 

knowledge of concepts or p^^)c^du'res. On the other hand, workbook exercises 
tend to be more testlike or cognitive In nature and frequently use multiple , 
choice questions, fom filling exercises, and so on. Whereas only a 11n\1ted 
number of ^s It iiation^^ be covered In practice Interviews, a well designed ^ 
workbook exercise c^rcover a large variety of problems In a short period 



. of time. \ -■ . 

Evatuation Measureg^Used at the End of Training 

As the Bureau, has gained experience with centralized , telephone 1nt6r-.; 
viewing, the trend in training hjas been to develop measures of performance 
that Indicate whether or not an Interviewer Is minimally capable to perform ^ 
on the job. Assessment has generally focused on two areas: conceptual 
knowledge of qiieirti on sped f,1 cations. and procedures and demonstrated skill 
' as an Interviewer. To assess/these skills, the Bureau has experimented 
with the use of an end-of-traiinlng conceptual test and a "test" ihtervlew . 

* conducted with trained professional staff;. - - ? , 

. ■ ■■ ■ . i ■ .■■ . •■ - " « . 

^ The conceptual tests, for'the most parti have xonslsted- of multiple H^^^^ 
choice items, although form completion exercises have also- been used. The 
"test," Interviews used at the end of training have tended to be moderately 
difficult scripted Interviews, Volunteers from the Bureau's professlon^aT 
staff have served as respondents and have rated Interviewers on a variety 
of criteria, such as pace of the interview, cl a Mty of questioning, use of 
probes and clarifications, and attitude.' 

' • ■ • ^ . . * • . , . ■ ■ • . ' 

Interviewe r Evaluation Measures Used after Training 

• ■ • ■ .. ' . ■ ". . . , ■ • . • 

Viewing selection, training, dnd supervision as critical components 
; of the entire process required to produce a proficient telephone inter- 
viewer,' the Bureau has recently experimented with the use of monitoring 
systems that differ from the subjective rating scales of performance commonly 
used. Rather than, continuing' to focus solely on^ the use of criteria, such 
as production rates, response rates, edlt-errpr rates, and cost' per Interview, 



the attempt his been mader to quantify the Interactive process between 
.Interviewer and respondent and to rate Its quality on a vaHety of dimen- 
sions. The general, goals of this research are to Ideritlfy^the critical 
dimensions 'Of Interviewer-respondent Inte^ractlon so that des-^ red Interviewer 
behaviors can be' Identified and stressed In tralnlfig/ r 



^ The approach being used Is based on an Interactljon analysis model 
developgd by ph. Charles Cannell of ^ther University , of Michigan- (Survey 
Research. Center). This approach uses behavioral rating categortes to 
quantify such Interviewing skills as question disking, pace, voice, clari- 
f-1cations,-prob1ng,-and-the-use-of— feedback. — HowfrV4r-*-rather-thanIuse-the 
more complex system ^leveloped by Dr. Cannell , the BureQu has developed a. 
simplified system with fewer rating categories (see Table 4). •. 



TABLE 4 • 

• • . ■ ■ ' ■ ■.. ■ ■ ' ., - 

RATING CATESORIES FOR MONITOJIING INTERVIEWER PERFORMANCE 



QuestiornAsking 

Q • Read queistion satisfactorily 

0. • Modified question and altered rrViBaning 

a^|_ • Read inappropriate question . 

Q_ • .failed to read a required^'question . 

Q V« Read questions but of order ' ^ 

'0-". ■■ y.: j ■ ■ ■ . - • ■ ■ 



Probing 

P • Probed correctty 

f •-Probed Incorrectly ' 

P • Probed unnecessarily 

P_« Did not probe when necessery 



Clarifications/befinitions 

C • Clarified question or defined concept(s) correctly , , 
t • eiaeified question or defined concept(^{|^inc(orr€khlY t 
C« • Did not clarify question or def ing cohcept(s) when necessary i ; 



Responsiveness - 

R • Responded correctly to relucfance^or extraneous cormments 
41 p Responded incorrectly to reluctance or extraneous bomrnerits. 
R_ • Did not respond to reluctance or,6xtraneou$ comments 



• To date ^ the monitoring system has been used to monitor interviewer 
"performance in a centralized telephone interviewjiog f^c 
Random Digit Dialiiigjinterviews. Although no definitive results are >' 
availlable as yet," sonie prqWems with the use of such a monitoring system • 
in a production faptiTty Kave' emerged;^ First, it is' a rel-atively expensive 
system to Implement and jwaintain, since extensive training .must be given to 
interviewers selected as monitors. Fufrther, the system generates a large 
amount of data which must be reduced, interpreted, and'the results presented 
to the interviewers. Finally,* field supervi^sors havp questioned the valuis 
of the results for anything other than research purpd^^^^^Cpnsequently j ^ 
the Bureau has continued to use the monitoring system ISut has struggled : 
-with-th^-question-of-whether— it-will-yltimatel^^^^ 
.or research tool. . ^ ^ ^ * ^ . ^ 

/ V 'oQuestidnis that remain to be answered are "^ho shoirW 
often should interviewers be' mdriitored?*' and "What happen^^^to tnter-monitor ^ 
reliability over time? Specificilly, even if ihter-monitor Tfe^ability r^- : 
mains ^the same, does the reliability of. the procedurejchange?"^^vqr ^ 
itvis conceivable that inter-mdnitor reliability couTcl^remain higlrtj^r a 
peri od4)f .time, but rater agreement with a standardized, baseline, scrifit 
could actually decrease. ^ \ \> 
• '''' • ^ ; ■■" ■ \., ■ ■ \' ■ ' ■ -.. X.- : 

Obviojisly, an important crite^rion for evaluating any new quality controlX 
system is' the iijnprovement in measurable perfdrm^nce that results fromrits ^ 
use. To date,'tltis type of ^cost-benefit analysis has not been, done, , so: it 
is unlikely tha^the monitoring.system will soon Ije used on a widespread 
basis for produdli on interviewinrg. ' However ^ it is^expected that^the Bureau 
will continue to experiment with its use. / ' " , 
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ILLUSTRATION 1; "Table of Contents" from the job-aid manual . 
' CONTENTS 



'1. Conductinig an Interview and Completing this Questionnaire. , V . . . . .... . . . . . . . . . . . . ' 

IA. Major Steps in.Vour Job ...... i . . . . ... . . . . . . . .1 

IB. Job Materills-Chfecklist ; . . . . . . . . . . ........... . . . .^.^ . . . . . . . * . . . . . . . : 

ICaCornpletingthe Address- LBbcl. •-•'•'«-•-•'•:• •-•~»7**^^ •••-••-•••> •-• • i • • % 

ID. Gbmpietirtg Itism 2 on Back Page of the Questionnaire • • • • • • • • • • • • . • . . . . . . . . . ^ 

IE. Completing the FOR CENSUS USE OiyLY Box. . . . . ......... . . ... ....... I 

... Occupied Ho(4Sing Units • •......*«....•..... - % 

Continuation Questionnaire ...». ! 

^ ^ a Ca n^ Housing -Units -.-.->-.->-.-.-•->-.-»-»-. -.^^»-.7»-»-«-*-^-*'-*~»T»-»-»-»^ 



... Vaca n t^ Usu a I hi.onie Elsewhere . • . ».*. • ..... • .•. • • • •• . • • * .3 

IF.' Renrovfng a Person From a Questionnaire. . . . . . . ^ . . . ..... • . . . .> . . . ....... .v^ * 7 

^ 1G« Identifying Separate Housing Units* /. » • .•. . . . .^1^ .>>#>•.. . . . . . . • . . . . . '»,. '• • • • 8 

'1 H* Age Conversion ^Table • . . .»....•.•■».• . .... ..'.(■•.. . <■ • . . .... . . . . . « . . . . . v^.. • • 9 

2« Reporting Progress and Costs. . . • ... • . . . . . . ... . i .......... • .. • • • 10 

2A. Recording^Daily Progr^ on the Master Address Register Cover . . ..... . . • • > • • • > • • 10 

2B/ Reporting to Your Crew Leader 1 ^ . ^ . ^ » . . . ^ . 11 

2C. Crew Leader Revieyvs of Your Work ........ ^ .v • 11 

First Revievv . ... . . . ...v. . . ..... .......... . . ..................... ..y. 11 

Final Review.... ...... ^••••^•-'^•••••^••••••'••^^^^^ 

20. Payroll Forms .............'...i. «... ........................... • - 12 

2E. Intermittent Employees Pay Periods: 1980;^ vv^r. . vv . v; .> v . v^vrr^^^^ 

2F. Commonfy^Asked Questions About Your Job and Their Answers. . 

• v^^v-: v>;- ■ - - - 

3. A Housing Unit 1$ Occujpied . . • . . . ^ • • • • • • • • • ..... . . . . • . • .«..•.». ^ ..... . *17 

R^bndeht JFte^ Efe Interviewed . . . . . . .* . . V . . • • • • • • -^^ • • • • • • .y ; . . ; ' 17 

3B. No One Ahsvyers the Odor^^. . r . ... . ♦ . . . * • ..... v 4 . • • • •j^ • • • • • • • • • • • y • * • • 18 

3C. Respondimt Says a Que^ionnaire^^^^ Mailed tn;. . . . . . . . . . . . . . . . . . . . ; . y. 20 

Respondent Lives in aii Apertp^cnt. . * .t. •>:;* 20 

Respondent Uyes in a Sing!e«Famil|^House ...... . .\ . ..... ... ... . • . . yii:,^:;^^^ 

30. N/isitors Are Present • ... . •■ . • . • . . . . . . ..... • • • . .. ... . .... .... • 1 22 

— ■' 3E* There Ari^ 8 or;9 People ...... • •^•,« ••• • « .22 

. :3F. There Are 10 or Morii People • • • • • • •. .v . . • ... . • . • . .'..«... . • • • . • . . • • 24 

3G. Respondem Ooes Not Know Informa 

Unit. . . . . ..... ; . . . . . . : .... ... ... ..... i . / . . ^. . . : .. . ... ... . . .... . . . - ; 25 

' The 'Person tl^ally Lives There. . ... ..................... . . . ... . . .....^ . . •25 

Checklist for Completihg the Individ Census Report .^ . ^ v • • • • • • • • • • • • • • • • 25 

^fone of the People Usudly Uve in #r H^ Unit . ........ • • 25 

3H.; None of the People Usua^ . . .a...* . . .... . . 28 

^ 91. Jfe^^Pind^^ pid Not Live in^t^^^ on p»nsus Day . . ^ . . . ^ . . .... .... 32 

3j. ^Respondent Ooey^ .... • . . . . . ^ . . . . • . • • • • . • • 33. 

3K. The Address Is a Special Place.i^. ... . . • . • • . . ... .>.:. .. ......... • .* 34 

' 3L.sv^The Hpusing Unit RecetvedTwo Questionnaires. ........ . . .. . .... . . * . . ....... • 3B 

3Mw Apartment Numbels (b^JLet^ DoTlbt Matfeh those Entered in Column 4 of the 
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